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CONCLUSIONS 


A specific second-order digital phase-locked lopp (DPLL) has been modeled as a 
first-order Markov chain with alternatives. From the matrix of transition probabilities 
of the Markov chain, the steody-state phas'’ error of the DPLL was determined. In a 
similar manner the loop's tronsient response was calculoted for a fading input. 

Additionally, a hardware DPLL was constructed and tested to provide a com- 
parison to the results obtained from the Markov chain model . In all cases tested, good 
agreement was found between the theoretical predictions ond the experimental data. 


II. INTRODUCTION 

The phose-locked loop has long been recognized os o circuit with many important 
applicotions/ond as such, the description of analog phase-locked loops (APLL's) has become 
well known as a large volume of material has been published to facilitate their use. in 
recent years, there has been an increasing use of various types of loops employing discrete 
elements. Among these hove been hybrid PLL schemes thot utilize both analog and 
digital circuitry. Newer loop reolizotions have been circuits composed entirely of digital 
element (DPLL's). The importance of these types of configurations lies in the relative ease 
of design and construction and/of equal importance, the ease in which such circuits can be 
m'^intained. 

Unfortunately, the very attributes that make DPLL's attractive from a design stand- 
point also contribute to the difficulties in the theortical analysis of DPLL operation. In 
this area the available literature is relotively thin. For the area of analysis with a fading 
input, Weinburg and Lin ^ derive steody-state results for general first- and second-order 
DPLL's, but the analysis is limited by the assumption of small phase error values. In [2 and D] 
steady-state loop performance ir, the presence of Goussian noise is discussed for specific 
digital loop configurations. However, for both of these popers the analysis is limited to 
first-order DPLL's only. 

In a previous Technical Memorandum the analysis of a first-order DPLL was per- 
formed by modeling the loop as a first-order Markov chain. In the following, the ideas and 
methods used in this previous Technical Memorandum will be modified to allow a similar 
approach to be used for the analysis of second-order DPLL's, It will be shown that a second- 
order DPLL can be modeled as a first-order Markov chain with alternatives and thot these 
alternatives themselves can be thought of as stats in a first-order Markov chain. The 
steady -state distribution of the Markov chain alternatives can be determined and from this 
distribution it is possible to find the steady-state phase error of the DPLL. The transient 
response of the loop is determined in o similar manner. 

Also detailed in the following is the design and testing of a hardware DPLL copable 
of either first- or second-order operation. A primary design objective followed in the 
construction of the hardwore loop was to allow easy alteration of Important loop parameters 


/ 


to provide insight into their effects on loop performance. The general range of these 
parameters, however, was limited to volues thought to be useful for an Omega navi- 
gation receiver application. It must be emphasized, however, that neither the theory 
developed in this TM nor the DPLL design are in any woy limited to this particular 
application. 


Ill . MARKOV CHAIN MODEL OF SECOND-ORDER DPLL 

A. Second-Order DPLL Configuration. A block of the second-order DPLL 
configuration considered here Is shown in Figure 1 . This configuration differs from the 
first-order loop presented in [4] only by the addition of the S-bIt counter and adder 
blocks. For this loop, the input is sampled at the positive -going zero crossing of the 
reference clock and then quantized to a value of ± 1 . The quantized signal is applied 
directly to the divide-by-2 up/down counter (count up one on plus one ond 

count down one on minus one) giving first-order phase updating. The quantized 

hard-limiter output is also applied to the input of the divide *by- 2^ up/down counter 
which has the additional property that the counter will sah. ’ote at the limit points 
f 2 “1 • Once the counters have been updated their values are summed and the sum 

loaded into the (M + N)-blt counter. The phase of the reference clock is then set to 
a value determined by the contents of the most significant bits of the (M + N) h*t 
counter. 


B. Markov Choins with Alternatives. A Markov chcin can be char 
by a system containing a number of distinguishable states (finite or infinite) 
transition to a new state denoted s j from any present state sj depends soleh 
present state sj. For the present, assume that the numbe/ of states is N, 
for each state $j, i = 1 ,2, , . No vector of transition piobabilities may b 
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where p.. is the probability of transition to state s. given that the present state is 
s.. NoVe that the N transition probability vec tdrs must satisfy the requirement 

P)j '/i ” 1 / 2 / . . . / 


and 


N 

I p.. - 1.0 i - 1, 2, ..., N 
i=l M 


( 2 ) 


and are called stochastic vectors. These N vectors may be arranged In a matrix of 
size N X N to give the matrix of transition probabilities P. 
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Figure 1 . Block Diagram of Second-Order DPLL. 
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PnI Pn2...PnnJ 

Note that this matrix defines all of the state -to-state transition probabilities for the 
Markov chain with a finite number of states. 


A Markov chain can also be specified for which each state has one or more 
possible vectors of transition probabilities. For each state s., the possible vectors are 
called alternative vectors and transition from the present state to some new state is 
governed by one and only one of the alternative vectors associated with the present 
state. In this case, for each state s. there exists K. alternative vectors. 


k - (k k ... k ) i = 1,2,... N 

P|i Pi2 Pin k =1,2,... K. 

I 


(4) 


where p.. is the probability thc^j^the system will make a transition to state s. given 
that the pi’esent state is s. and k alternative for s. is used. As before, each of the 
alternative vectors of transition probabilities are stochastic vectors and must satisfy 
the conditions. 


and 


k >0 i,j-l,2, ...,N and k - 1,2, ... , K. 

r • • 

•I 

N 

I p.. = 1.0 i- 1,2,..., N and k = 1,2, ...,K. 
:=i 'I ' 


(5) 


The vectors may be 


combined h. give the K x N stochastic matrix, (P, 
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C. Markov Chain Model of DPLL. Use of the Markov chain with alternatives 
in the modeling of second- order DPLL*s wi 1 1 be shown with an example. Consider the 
DPLL of Figure 1 with M = 1, N = 2, and S = 3, Defining the possible states of the 
(M + N)-bit counter as loop statej^then the loop will have eight loop states while the 
reference clock is quantized to 2 =4 possible states. These eight loop states form 

the states of o first-order Markov chain. However, transfer from loop state to loop 
state is dependent not only upon the present loop state but also on the value of the 
S-bit counter. For example. If the value of the S-bit counter Is zero, then a + 1 
phase detector outputwill cause the (M + N) counter to be incremented by a value of 
+ 2. Similarly, a -1 phase detector when the S-blt counter is zero will cause the 
(M + N)-bit counter to decrement by a value of 2, However, if the value of the S-blt 
counter Is +1, then a +1 phase detector output will cause the (M + N)-blt counter to 
increment by a value of 3 while a -1 phase detector output causes the counter to 
decrement by a value of 1 . Since the possible values of the (M+N)-bit couriter are 
associated with the states of a Markov chain, then the possible values of the S-blt 
counter can be associated with alternative actions for each loop state. Thus for the 
present case of S=3, there are seven alterrwjtive actions associated with each loop state. 

A state diagram of the Markov chain model with alternatives for the DPLL under 
consideration Is shown in Figure 2. Since there are eight possible loop states with each 
having seven possible alternative actions, there are a total of 56 alternative acti< ns for 
the entire loop; or in terms of Markov chain notation, there are 56 alternative vectors 
of transition probabilities. For each loop state the alternative vector to be used is 
uniquely defined by the value of the S-bit counter so that the alternative vectors them- 
selves can be thought of as states in a first-order Markov chain. That is. Instead of 
considering the transitions from loop state to loop state, the transitions from loop alter- 
native to loop alternative are considered. Thus in the state diagram. Figure ^the loop 
alternatives are successively numbered ****56 possible transition from 

loop alternative to loop alternative is assigned a probability as indicated by the directed 
arrows. The values of the indicated probabilities are dependent on the state of the loop 
reference clock only. The method for determining their value was discussed in [4]. 

Denoting the steady-state probability of loop occupancy of state s. as a. then from 
Figure 2, ' ' 


^1=‘’30P3'^°29 P 3 


(7) 


It is clear that there will be 56 such equations which can be put in matrix form as 


[A] 


[ 0 ] 


( 8 ) 


56 
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Figure 2. DPLL State Diagram. 






for which a unique solution does not exist. However, since a. represents o steady-state 
probability then 

56 

I a. =1.0 (9) 

i=l ' 


so that the above homogeneous system in conjunction with this additionol constraint 
can be solved for the steady-state probabilities a.. If the steady-state probability of 
the occurrence of the clock state is denoted as R, then 


M+S 

L + 2 -2M 


i=L 


a. 

I 


K=l,2, ...,2 


N 


( 10 ) 


where 


L=(k-1) [2^'^^-2M]+l 


( 11 ) 


The distribution of Rj^ then establishes the statistics for the phase error of thr i')PLL, 

A similar method is used to find the mean time to loop lock-up for a given 
initial state. For the loop represented by Figure 2 with a noiseless input signal. 


P 


1 



= 1 


and 



= 0 


and it is easy to see that regardless of initial state the loop will move to a stable condi- 
tion involving a transition loop of, 

^ 8 * ^ 32 "^ ^19 ■^^25 

Thus, occurrence of any of fhese four states can be used as defining the lock-up condi- 
tion for the DPLL. Denoting T, as the mean number of loop transitions to a lock-up 
condition for some initial state s., then a set of difference equations can be written in 
terms of mean time to loop lock as was done for the determination of steady-state loop 
probabilities. For instance if the loop is initially in state then 

Clearly, a similar equation can be written for each initial state. Note, for state 
^38^ ^32^ ^19^ Q^d ^ 2 ^ then 

^ 38 ^ ^32 ^ ^ 19 ^ ^25 

since the loop is defined os being initially in a lock condition. 
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D. ApplicoHon of the Morkov Choin Model. The DPLL's steady^stafe distribution 
and transient properties are detennine by a solution of the systems of equations given by 
(8) and (9), respectively. A computer program PBSTGEN was written to establish the 
state- to-state transitions (i.e. , the systems of equations)for arbitrary values of M, N, and 
S. Using the output of PBSTGEN a second program ^BDPL2/ solved the system of equations 
to find the steady-state phase distribution for the DPLL. Similarly, the output of PBSTGEN 
by another program, PBDPL2T, to solve for the mean time to lock for an abritrary initial 
phase offset. In both PBDPL2 and DPL2T, Jacobi's iterative algorithm was used to solve 
the system of equations. These programs may be found in Appendix A. Results obtained 
from these programs will be presented in a later section of this TM. 


IV. DIGITAL PHASE-LOCKED LOOP DESIGN 

To demonstrate experimentally the validity of the Markov chain model described 
in the previous section, a hardware DPLL was designed and constructed. A block diagram 
of the hardware loop is shown in Figure 3. Ail register lengths shown in the block dia- 
gram indicate the maximum values and during testing the actual register lengths were alter- 
ed to verify the effects of various parameters upon loop performance. 

Refenring to Figure ^ the phase detector will sample the incoming binary signal of 
frequency f and then output a count-down signal if the sample is ci ZERO or a count-up 
signal if the Input Is ONE. The count-up or count-down signal Is then applied to both 
the S-bit saturating counter and the (M + N)-bit counter. Inhibiting logic is included with 
the S-bit counter so that the counter will saturate at selectable values of + (2‘ -i) , i 
2, ..., 7. The sample command also initiates the control logic so thot the new value of 
the (M + N)-blt counter (following the count-up or count-down signal) is loaded Into the 
12-bit btjffer by means of the LOAD2 signal. After settling, the output of the 12-bit 
adder will contain the sum of the S-bit saturating counter and the (M + N)-blt counter. 

This value is then loaded into the (M + N)-bit counter by means of the L0A[)I signal. 
Note, the value of the N most signlflcont bits represents the phase estimate of the DPLL. 

To establish variable phase reference clock, this phase estimate is compared to the value 
of an N-bit counter being clocked at c 2^ * f rote by cn N-bit binary magnitude 
comparator. Upon coincidence of the two input words the magnitude comparator output 
takes on a value of ONE. Note that this pulse output occurs at on f rate. Notice olso 
that this loop will operate in the first-order mode simply by inhibiting the LOADI signol 
to the (M *■ N) counter. Detailed schematics for the DPLL may be found in Appendix B. 

The basic test configuration used for all DPLL experiments is shown in Figure 4. 
Since it was primarily desired to determine the steady-state phase error and the mean time 
to lock for an initial phase offset it was possible to use the same clock source for both the 
DPLL input and the external reference source. A Sulzer temperature xompensated crystol 
oscillator was used as the reference source to minimize effects caused by frequency drift 
of this source. This source was quantized to binary levels and applied to both the DPLL 
variable phose reference clock and a phase shifting network. The phase shifted clock 
was then filtered, mixed with noise, and hardlimited to provide a noisy binary input to 
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the DPLL. The phase estimate of the loop is continously stored in a buffer register fo 
provide a parallel digital phase output* This value is also a^ >lied to a D/A converter 
to provide an analog phose output for monitoring purposes* 


V. ANALYSIS AND HARDWARE TEST RESULTS 

Solutions to the systems of equations describing t!ie Markov chain model for 
the DPLL were performed for various loop parameter values by means of the computer 
programs found in Appendix A* Of prime concern was the steady-state phase error 
and the transient response of the DPLL tV a fading input. In addition, data was taken 
from experiments involving the hevdware DPLL to determine both of the parameters for 
comporison to the results obtained frt>m the Markov chain model. 

Figures 5,6, and 7 are plots of standard deviation of the phase error for the 
DPLL os a function of noise-to-signal ratio for various loop parameters. The results 
obtained from the Markov chain model are overplotted with the experimental results 
and, as can be seen, there is close agreement between the two. Notice for the case 
of S=1 the loop is operating in the first-order mode while for S greater than one the 
loop is operating second-order. Referring to these three figures it is seen that for 
constant M and N there is a reductic of 5 to 10 dB in loop performance as S Increases 
in unit steps. Similarly, as S and N are held constant, there is a 5 to 10 dB increase 
in loop performance as M increases in unit steps. 

Figures 8-14 are plots of the loop transient response for various loop parameters 
and signal-to-noise ratios. Again the experimental results are overplotted on the 
theoretical prediction:. Each experimental data point represents the mean of at least 
500 trials and once again there is good agreement be^ween experimental and theoretical 
dota. A particularly significant result may be found from a comparison of Figures 8-10. 
From these figures it is seen that for small values of initial phase offset, the mean time 
lock increases with an increasing value of S. That is, for small phase offsets *he first- 
order DPLL will achieve lock in less time than will a second-order DPLL. This is likewise 
found to be true when o: iporing Figures 11-13 and can be a significant factor in selection 
of loop parameters for on application such as an Omega navigation *-tceiver. 
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VII. APPENDICES 


A. Fortran Programs UseJ for Solution of Morkov Chain Model . 
Reference Section III - C and D. 
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B. Binary Phase-Locked Loop Design. 


The following sections dlscuu In detail the design of the hardware DPLL used to 
validate the Markov chain model. The block diagram for the DPLL may be found In 
Section IV, Figure 3 of the main text. 

a . Binary Phase Detector. Referring to the schematic of Figure B-1 , the 
binary phase detector operates by sampling the binary Input signal f^ and producing a 
complemented pulse output on either the count-up or count-down line. This function 
Is produced by three D-type flip-flops as follows. Ihe OPEN SW signal Is applied to 
the clock input of ff B3 ^lle the binary signal f^ 1* applied to the ^ta Input of the 
same ff . Thus on a positive transition of OPEN the value of f^ Is latched, giving 
the sampled value IN at B3's Q output. The two ff's of A6 are Initailly set to the 
ONE state ^ so that when SET LAT latches the Input values to the ff's ON and IKl), 
one ff goes to the ZERO «tate whil e the other remains in the ONE state. The SET LAT 
signal Is followed by the CLk LaT sigrtal which sets both ff's to the ONE state. Thus 
the count-up or count-down ore produced In a mutually exclusive manner when orw 
of the ff's of A6 toggles HIGH LOW HIGH while the other remains HIGH. 

b . S-bIt Saturating Counter. The saturating uptown S-bIt counter is 
shown In Figure B-2. The counting function is performed by two serially connected 
741 93 4-bit synchronous up-down coun ters. The ou p ut states of the counter is de- 
tected by a logic network to produce the INHIB UP and INHIB DN signals that will 
inhibit the UP and DN clock signals respectively. For example, if switches SW1 
through SW6 are closed, then for a counter state of 0000 0001 the INHIB UP signal 
will be TRUE,thus inhibiting the UP clock signal and saturating the counter at that 
value. Note, a DN clock signal will still count the counter to the 0000 0000 state . 
Similarly, for all switches closed and the counter in state 1111 1111 the INHIB DN 
signal will be TRUE and the counter is saturated at that state. If switch SW1 is opened 
while all other switches remain closer^ then the counter saturation states will be 0000 
0011 and 1111 1101 (+3). Continuing in this manner, the counter saturation states 
may be selected to be ii' -1, I = 1,2, . ..7 by opening switches SWI through SW (i-1) 
while all other switches remain closed. 

c. (M + N) -Bit Counter. The schematic for the (M + N)-bit counter along 
with the buffer register and adder are shown in Figure B-3. The (M + N)-blt counter 
consists of three serially connected 741 93 4-bit up-down counters. Following on UP 
or DN clock signal the value of the (M + N)-blt counter is loaded Into the 1 2-bit 
buffer register composed of two 74174 hex D-type flip-flops by the L0AD2 signal . 

The values of the 12-bit buffer and the S-bit saturating counter compose the inputs 

to the adder circuit consisting of three 7483 4-bit binary adders. The ouput of the 
1 2-bit adder Is applied to the preset terminals of the (M + N) -bit counter. If the type 
select switch is set for first-order operation, the adder output will not be l ooded into 
the (M + N)-bit counter. If a second-order loop is selected, the LOADI signal will 
be applied to the load inputs of the 74193's thus presetting the (M + N)-blt counter to the 
value of the 12-blt adder output. 


- 32 - 




d . Vorioble Phose reference Clock . Referring to Figure B-4, six selectable 
contiguous bits from the + N)-blt counter ore applied to one input side of a binary 
magnitude comparator formed by two 7485 4-bit magnitude comparators. The other 
input to the comparator is obtained from the lower N bits of the two series-connected 
741 93 counters that are being clocked at a rate of 2^ time the Input frequency. Thus 
the EQUALS output pin 6 of A31 , of the magnitude comparator will be a ONE when 
the two inputs are equal and this will occur at a rate equal the input frequency f^. The 
circuit formed by A33 and A34 prevents the sample output from occurring at a rate 
greater than f^ , For example, if pin 8 of A34 is HIGH then when the magnitude 
comparator detects the equal condition, pin 5 of A34 is set HIGH causing t he phos e de- 
tector to sample the input signal . The SAMPLE signal Is reset LOW by the LdAbl 
signal at the end of the loop phase update. However, since the (M + N)-bit counter 
may have counted up during ^e lost phase update and the counters of the reference 
clock have also counted up, I;t,is possible for the magnitude comparator to detect equal 
states occurring at a rate of 2^ *fg. Thus it Is necessary for the HDTOT signal to reset 
pin 8 of A33 to a ZERO so that another somple cannot occur unit the reference clock 
counter loads a ZERO into that flip-flop. 


e. Control Logic. A timing diagram for the necessary control waveforms and 
the logic schematic used in their generation are given in Figures B-5 and B-6, respec- 
tively. Use of the control waveforms has been described in the previous sections. 
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Figure B-1 . DPLL Binary Phase Detecfor. 
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Figure B-2. S-Bit Saturating Counter. 























Figure B-4. DPLL Vorloble Phase Reference Clock. 
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